Papers with Trident Preference Regularization
Trident: Self-Supervised Preference Alignment via Triplet Regularization (2026.findings-acl)
Copied to clipboard
| Challenge: | Large vision-Language Models suffer from noisy supervision and semantic ambiguity in self-supervised settings. |
| Approach: | They propose a self-supervised framework that constructs reliable preference triplets . they propose 'trident' objective that enforces semantic separation between the triplet components . |
| Outcome: | The proposed framework outperforms state-of-the-art RLHF and RLAIF benchmarks on LLaVA-1.5-7B and achieves 95.70% precision on POPE using only 4k self-generated triplets and a single epoch. |